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George : 


, — “ Lue rresentation 

Richard R. Schleffelin (QSl Contractor) 

IS presenting in Chicago on 25 March 
at the DPMA Conference! ^ 
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QUALITY SYSTEMS INCORPORATED 

8401 ARLINGTON BLVD., FAIRFAX. VIRGINIA 22031 
(703j 573-7449 

RICHARD R. SCHIEFFELIN 

PRINCIPAL QUALITY ASSURANCE ANALYST 
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Contract Activities Overview 

Projects 

• Systems Integration 

• Systems Development 

• Systems Performance Evaluation and 
Enhancement 

• Systems Quality Assurance 

Method 

• Apply System Engineering Principles to 
Quality Assurance Problems 
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9 ^ 

“IMNAGEUENT SUPPORT 
HAS BEEN WON ” 


QSI EXPERIENCE CORROBORATES 

• QA Institute Survey 

• Bill Perry’s article in Government Computer News 

IN ADDITION 

• Charter and Mission Have Been Established 

• Standards Are Being Used 
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COMPARATOR PLAN PROGRAM EVALUATOR 
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QA HBSM FUNCTIONS ^ 


TEST DATA MANAGER PANVALET QTRAK RTM 



DOCUMENTATION EVALUATOR POL EVALUATOR OTRAK RTM 
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OTRAK CRM PAC-II 
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TOOL MAME— Test Data Manager 

WHAT IT IS 

• /tutomated test data control and generation program 

HOW IT 
WORKS 

Using structured specifications: 

• Generates test data for acceptance test 

• Provides control of test data 


• Repeatability of test data assured 

• Minimum resources required 

PROBLEMS 

• Start-up costs in small projects 

• Large data storage requirements 

FOTORE 

• Reductions in storage media cost make data 
generator more and more attractive 
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TOOL HAHE— Boole & Babbage Plan Program Evaluator 

WHAT IT IS 

• Comprehensive extractions and reporting system to analyze 
system and problem performance 


• Builds a comprehensive central file of data 

• Provides activity usage profiles for evaluation 


• Time/usage profiles allow identification of small areas (5—10%) 
of code that use large (50—70%) amounts of resources 

• Minimal code changes provide maximum time savings 

PROBLEMS 

• Large extractor data files 

• Additional module analysis may reveal recoding requirements 

• System priority required for fixed resource allocation 

FUTURE 

• Improvements in evaluator being made to support real-time 
examinations 
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^ TOOL NAME— Documentation Evaluator 

WHAT IT IS 

• Program takes structured specification and compares it 
to standard 

HOW IT 
WORKS 

• Evaluates various levels of standard outline against document 
outline 

BENEFITS/ 

COSTS 

• Rrst-line check on great volume of documentation 

• Efficient and saves resources 

• Simple program 

PROBLEMS 

• Requires maintenance 

• Document and standard must be softcopy 

• No content analysis and document specific 

FUTURE 

• Greater use on large projects but needs refining 
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■ DOCUMENTAT10M EVALUATOR 

^ TOOL NAME— Comparator 

WHAT IT IS 

• Software library control program to compare two versions 
of the same computer program 

Howrr 

WORKS 

• Reads two files and lists the differences 


• Identifies changes 

• Simple to use 

• Very efficient for large complex systems 

FBOBLEHS 

• Initial reference point for each module must be explicitly defined 

FOTDRE 

• Greater use on large projects 
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WHAT IT IS 

• Compliance checker for PDL constructs 


• Checks constructs if-then-else, do-while, etc. 

• Lists variations from pre-defined constmcts 

BENEFtTS/ 

COSTS 

• Ensures standards compliance 

• Minimizes coding errors 

• Ensures correct input to code generator 

PBOBLEHS 

• Not a direct map from evaluation package to original standards 

FUTURE 

• Increased use to ensure more efficient and maintainable code 
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TOOL NAME— Panvalet 

• Program management and security system 

• Builds and maintains a library of software modules 

• Source code, object code, load modules, JCL 

• Special text files 

• Rexible • Compatible with most systems 

• Efficient use of space • Good reporting functions 

• Simple to use 

• Dedicated librarian required 

• User training necessary 

• Batch system use extended to VM/CMS environment 

• Growing use of library management and control systems 
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TOOL NAME— Automatic Change Control, Management & Distribution System (CMD) 

WflATITIS 

• Information management system for electronic mail, file 
management, and user communication 

HOW IT 
WORKS 

• Allows users to create format, review, send, and receive 
documents in a controlled, easy manner 


• Solves physical space storage problems 

• Access is controlled by classification, passwords, and privileges 

• Extensive accessibility 


• Electronic mail is dependent on a reliable and available 
computer system 

• No backup 

• System administrator required 

FOmRE 

• Continuing improvement in user language and human engineering 
factors being made to enhance system 
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TOOL NAME— QTRAK Communications & Reporting Moduie (CRM) 

WHAT nr IS 

• Tracking system for problem reporting 

HOW IT 
WORKS 

• Data base query and reporting moduie 

• Audit, track, report on problem data base 


• Minimizes data entry 

• Real-time status reports 

• Programmers can query CM records from terminal 

PROBLEMS 

Requires: 

• Training 

• Maintenance 

• Dedicated system administrator 

FQTDBE 

• Increased use, most current status accounting reports possible 
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TOOL NAME-PAC-II 

WHAT IT IS 

• Computerized project management system 


• Allows planning, budgeting, monitoring, 
analyzing, and costing of projects 

• Batch/interactive system 


• Hanning anaiysis using interactive system 

• Hethora of management reports 

• Graphic capabiiities 

PROBLEMS 

• Start-up time required 

• Ranner/administrator training required 

FOniBE 

• improvements being made in MiS graphics 
interfaces 

• Expanded use of exception reporting features 
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TOOL NAME— QTRAK Requirements Module (RTM) 

WHAT IT IS 

• Automated requirements traceability matrix 


• Module for tracking requirements 

• Indexes on requirements and documents 


• Requirements traced through life cycle 

• Automated exception notification 

• Quick, easy to use 

PROBLEMS 

• Requires maintenance 

• Data integrity must be assured 

FUTURE 

• Increased use as systems become more 
complex 
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TWH. NAME— Data Catalogue 2 

WHAT IT IS 

• Automated data dictionary and tracking system 

HOW IT 
WORKS 

• Establishes relational and hierarchial 

• Automatically track, monitor, and query to data 
element level 


• Automatic generation of program structures 

COBOL, PL-1, ASSEMBLER 

• Interactive query and update features 

• On-line report generators 

PROBLEMS 

• Complex system to be used with large problems 

• Startup time 

• User training 

FUTDRE 

• System Improvements being made for custom dictionary facility 
to be used with top-down structured methods 
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TODAY’S QA ISSUES 

PBORLEMS 

• Significant gap in credibility and support from project personnel 

—Lack of trained QA professionals 

—Insufficient use of tools to support QA mission functions 

SOLUTIONS 

• Increased professional training 

• Tools as a solution 

—Help projects do a better job 
— Rnd potential problems before become problems 
—Provide impartial judgment 
—Use most current methods 
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FIRST STEPS HAVE BEEN MADE FOR INCORPORATION 

• Management Support 

• Charter and Mission 

• Standards 



£ NEXT STEPS 

• Winning Credibility and Acceptance 
—Training QA Professionals 
—Greater Use of Tools 


QAMUST 

• Match the Available Tools with Functions 

• Optimize Use 

• Demonstrate How Tools Can Make QA and Workers More Efficient 

• Develop Additional Tools 


Sanitized Copy Approved for Release 2010/06/07 : CIA-RDP85-00142R000300200012-6 


